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Abstract. A systematic Hterature review was conducted to assess the effectiveness of strategies to improve community 
case management (CCM) of malaria. Forty-three studies were included; most (38) reported indicators of community health 
worlcer (CHW) performance, 14 reported on malaria CCM integrated with other child health interventions, 16 reported on 
health system capacity, and 13 reported on referral. The CHWs are able to provide good quality malaria care, including 
performing procedures such as rapid diagnostic tests. Appropriate training, clear guidelines, and regular supportive 
supervision are important facilitating factors. Crucial to sustainable success of CHW programs is strengthening health 
system capacity to support commodity supply, supervision, and appropriate treatment of referred cases. The little evidence 
available on referral from community to health facility level suggests that this is an area that needs priority attention. The 
studies of integrated CCM suggest that additional tasks do not reduce the quality of malaria CCM provided sufficient 
training and supervision is maintained. 



INTRODUCTION 

Malaria remains one of the leading causes of preventable 
mortality worldwide, despite substantial improvements in 
control over recent years made possible by increased funding. 
Prompt and effective treatment is a core strategy of national 
malaria control programs. The Roll Back Malaria Partnership 
set the target for achieving and maintaining universal cover- 
age meaning that "80% of malaria patients are diagnosed and 
treated with effective antimalarial medicines, e.g., artemisinin- 
based combination therapies (ACT), within one day of the 
onset of illness".' Since 2010, the World Health Organization 
has recommended parasitologic diagnosis rather than presump- 
tively treating all fevers as malaria.^ 

Available household survey data on progress towards the 
goal of universal treatment shows that the median proportion 
of children less than five years of age with a fever who sought 
treatment in sub-Saharan Africa during 2010-2011 was 59% 
(interquartile range [IQR] = 48-76%)."' Among children 
treated with any antimalarial drug, the percentage receiving 
ACTs varies across countries from < 5% to > 90%."* A crucial 
factor contributing to low coverage of prompt and effective 
malaria treatment is the weakness of national health systems 
to deliver interventions in most low income countries."^ One 
potential solution to improve access is to take services closer 
to communities by training local community health workers 
(CHWs) in the provision of diagnostic and treatment ser- 
vices.*'' In this report, we define community-based manage- 
ment of malaria as provision of malaria diagnosis and 
treatment by lay members of the community, without previ- 
ous formal medical training but trained in basic management 
of malaria (with or without other basic health services). 

A systematic review on the health impact of home-based 
management of malaria (HMM) was published in 2007 and 
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provided a comprehensive analysis of studies conducted and 
published in the pre -ACT era.* ** More recently, several large- 
scale studies and programs have been funded that represent a 
shift in the international focus from HMM or community case 
management (CCM) of individual diseases to integrated com- 
munity case management (iCCM).'''*^ This report expands the 
2007 review by Hopkins and others** in the current context of 
use of ACT and rapid diagnostic tests (RDTs) at the commu- 
nity level, which has increased the level of complexity of the 
tasks for which CHWs are responsible. It is important to 
understand the impact of interventions on outcomes other 
than morbidity and mortality, such as intervention coverage 
and quality of CHW performance to inform best practice for 
existing CHW programs and to identify areas where further 
research may be needed. 

We conducted a systematic literature review to assess the 
evidence for interventions to 1) increase the quality of ser- 
vices provided by CHWs responsible for malaria case man- 
agement among children less than five years of age; 2) integrate 
malaria diagnosis and case management with other health 
services at the community level, with particular emphasis on 
case management of uncomplicated pneumonia; 3) increase the 
capacity of health systems to support case management at the 
community level; and 4) strengthen referrals from the commu- 
nity to facility-based providers. 



METHODS 

Where relevant, we followed the Preferred Reporting 
Items for Systematic Reviews and Meta-Analyses statement 
and checklist in designing and reporting our review.'^ The 
online databases CAB Abstracts, EMBASE, Global Health, 
MEDLINE, and PsychlNFO were searched using the terms 
malaria or fever, community, and home management or case 
management or treatment or integrated or referral. Gray lit- 
erature was accessed by searching websites of development 
agencies and organizations involved in malaria CCM pro- 
grams. The searches were limited to publications from 2000 
onwards, and the last searches were conducted in May 2013. 
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No restriction was placed on language of publication. All 
records were screened by two reviewers. We restricted inclu- 
sion to studies conducted in sub-Saharan Africa, and included 
randomized controlled trials (RCT), clustered RCTs, pre-post 
studies with or without control, and interrupted time series 
designs with at least three time points pre -intervention and 
post-intervention. Post-only studies were also included where 
the outcome of interest could be attributed to the community- 
based intervention under study. For example, through review 
of CHW registers or household surveys with questions on 
treatment by source that were conducted after the introduc- 
tion of the CHW intervention (i.e., before the intervention 
there was no malaria case management conducted at the 
community level). 

Studies were included if they involved evaluation of an 
intervention to introduce or improve community-based man- 
agement of malaria where objective and standardized impact 
or outcome measures were reported. If linked to an included 
publication describing a community-based treatment inter- 
vention, qualitative studies, case studies, process evaluations, 
and cost-effectiveness studies were included to identify bar- 
riers to and faciUtators of effective implementation. 



Studies with an RCT or controlled pre-post design were 
assessed by two authors for risk of bias, based on guidelines 
from the Cochrane Effective Practice and Organization of 
Care group^"'; each study was given a classification of DONE, 
NOT CLEAR, or NOT DONE for the categories sample size 
calculations, randomization and blinding procedures (where 
appropriate), similarity of intervention and control areas at 
baseline, and completion of participant follow-up. 

Because of heterogeneity between studies in terms of the 
intervention and study design, it was not appropriate to con- 
duct a meta-analysis. Instead, content analysis and narrative 
synthesis were used to summarize findings and identify impor- 
tant influences on the quality of malaria CCM across studies.'"* 

RESULTS 

A total of 3287 papers were found by searching the online 
pubUcations databases. After screening, 43 papers from the 
published literature remained for final analysis. An additional 
three papers were included from the gray literature (Figure 1). 
The final 46 papers cover a total of 43 studies, where an indi- 
vidual study is defined as an evaluation of an intervention 



Community-based malaria 
treatment 

CAB Abstracts: 1274 

EMBASE: 2587 
Global Health: 1840 
Medline: 1670 
PsychlNFO: 121 
TOTAL papers: 7462 



Removal of duplicates 

▼ 

Total papers 
remaining: 3287 



Screening of titles & abstracts 



Total papers remaining: 
134 



Screening of full papers 



Reasons for exclusion 

No indicator of quality of treatment 
provided by CHWs: 38 
User knowledge/ demand side 
perspective only: 18 
Providers don't meet CITW 
definition: 17 
CHWs providing rectal artesunate/ 

chemoprevention: 1 1 
No treatment at community level: 7 



Total papers remaining: 
46 (43 studies) 



Papers from grey 




literature: 3 


► 



Figure 1. Flow chart of literature search and screening. CHWs = community health workers. 
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conducted in one site (country). The final 43 studies were con- 
ducted in 16 countries; 25 studies in eastern or southern Africa 
and 18 in western or central Africa. Most (81.4%, 35 of 43) 
studies were conducted in rural settings. 

Quality of included studies. Twelve studies used a cluster 
RCT to evaluate the intervention/^"^'' three used a controlled 
pre-post design,^''"^*' one pre-post without control,^^ and five 
studies were post-only with a control.^**"^" All of the 22 post- 
only studies without a control involved a direct evaluation of 
CHW performance (e.g., by review of CHW registers) or 
household surveys with questions on treatment by source; 
thus, the quality of performance could be related to the inter- 
vention and any contextual factors described.''^"'''' Although 
the post-only studies did not have a baseUne comparison, the 
evaluations were conducted after the introduction of the CHW 
intervention (i.e., before the intervention, there was no previ- 
ous malaria case management conducted at the community 
level). Thus, the quality of CHW performance was directly 
ascribed to the intervention package that they experienced. 

Overall, the quality of the 12 cluster RCTs was reasonably 
high, particularly in appropriateness and clarity of sample size 
calculations and minimization of selection bias through ran- 
domization. Similarity of the intervention and control arms 
at baseline was generally good in terms of the primary outcome 
of interest and general socio-demographic indicators, and the 
quality of studies in terms of measuring and reporting comple- 
tion of follow-up for study participants was mixed (Table 1). 

The quality of the three studies with a controlled pre-post 
design was considerably lower than the RCTs: All three 
studies found significant differences at baseline in primary 
outcome and socio-demographic characteristics between the 
intervention and control groups, which makes interpretation 
of results difficult because it is not clear whether any changes 
in outcome are caused by the intervention or to contextual 
factors (Table 1). 

The RCTs provided the greatest amount of evidence for 
interventions that integrated other health services with malaria 
CCM and those that measured clinical outcomes (Figure 2). 
The evidence for interventions to improve quality of CHW 
performance, health system capacity, and referrals was drawn 
primarily from post-only studies without control groups. 
However, RCTs provided the next most common evidence 
source. Clinical and non-cUnical performance-related out- 
comes were measured by both types of study and results were 
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Figure 3. Number of studies addressing each objective, by classi- 
fication of intervention. CCM = community case management; Tx = 
treatment; HS = health system. 



not noticeably different in magnitude or direction according to 
the quality of the study design. 

Characteristics of the interventions. Twenty-nine studies 
evaluated malaria CCM alone, 16 of these by presumptive 
diagnosis and 13 by confirmed diagnosis; the other 14 studies 
evaluated malaria CCM integrated with other basic health ser- 
vices (Supplemental Table 2). Thirty-eight studies reported on 
indicators of quality of case management by CHWs, (objective 
one of this review); 14 investigated integration of malaria CCM 
with other health services (objective two)2"-23-28-32-3y.4i.44-46. 
14 reported on some element of health system capacity 
to support malaria CCM, such as supervision, supply chain 
management, or treatment of referred cases (objective 
threeY'-'''^-''^'-^''''-™^-''-''; 13 provided information on 
referrals from the community to health facility level (objec- 

five 4)/5,18.27,30,33-35,38,39.41.43,45,46 ^5 ^j^jj^^ reported 

chnical outcomes''™^''^'-^'-^''-'"''^''' (Figure 3). 

The profiles of the CHW programs varied in terms of 
whether there were any incentives for the CHW or user 
charges. The CHWs in 14 of the studies received some finan- 
cial incentive, ranging from a small commission of a few US 



Figure 2. Number of studies addressing each objective, by study 
design. RCT = randomized controlled trial; HS = health system. 



cents per dose of antimalarial drug sold,^^'^^'^^'^"*'^^"*^ to 
a monthly allowance of US$15 or US$25 in a couple of 
cases.^**'''^'""''''*' In eight studies, non-financial incentives were 
provided in the form of bicycles or other equipment or pay- 
ment in kind from neighbours^"'^^'^**"''''"'^'''^; in four, intrinsic 
motivation such as pride and satisfaction in serving their com- 
munity was specified.^'^'^**'''''** Only four studies explicitly 
stated that no motivation was given,''^'"^'^^'^* although 17 stud- 
ies did not provide any information on CHW motivation. Of 
the 43 studies, 12 charged the user a small amount per dose of 
antimalarial drug (ranging from US$0-05 for chloroquine to 
US$045 for an ACT).^^"-^^^ In 18 studies, antimalarial drugs 
were distributed free;'^-^^-^"'^^-^'^-^'^'^^-^^-^^-^''^-^^-^'' and the 
remaining 13 studies did not provide information on charges 
to the user. The size of population covered by each CHW also 
varied (median = 692 persons per CHW; IQR = 409-1,740), as 
did the sex of CHWs (median = 43% male; IQR = 25-72%). 
However, certain characteristics were consistent across the 
studies, including that: CHWs were members of the community 
that they served and for the most part were elected during 
public village meetings; and minimum requirements for a 
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CHW were basic literacy, availability and accessibility, and a 
willingness to volunteer and serve. 

Interventions to improve quality of CHW performance: 
malaria CCM alone. Results from the 16 studies that involved 
presumptive treatment of malaria (without integration with 
other basic health services) found that CHW performance 
was high in terms of delivering the correct antimalarial drug 
and at the correct dose; among the nine studies that reported 
this outcome indicator, the median proportion was 97.8% 
(IQR = 94.8-98.0%)."-^^'^^-^^'^^ Prompt treatment seeking 
from a CHW was also high at approximately 90%, although 
this factor was only reported for four of the studies of pre- 
sumptive treatment of malaria.^^ An additional four studies 
reported on a combined indicator of prompt treatment with 
the correct dose, which was lower (median = 69.8%; IQR = 
55.2-75. 6%). Taking into consideration changes in 
the comparison areas, both studies with a controlled pre -post 
design found an overall increase in prompt and effective treat- 
ment that could be ascribed to CHWs (47.6% in Tanzania and 
13.5% in Uganda).^^-"** 

The evaluation of the national HMM program in Uganda 
and a regional program in Burkina Faso are the largest studies 
in the review and were conducted with limited external sup- 
port for supervision or antimalarial drug supply. These pro- 
grams showed more modest achievements in terms of CHW 
performance: 32.3% of children treated with pre-packaged 
chloroquine-sulfadoxine/pyrimethamine in Uganda received 
the correct dose within 24 hours'***; in Burkina Faso, 56.4% of 
febrile children were treated promptly with a pre-packaged 
antimalarial drug."*^ Reasons offered by the authors include 
the need for more community mobilization and stronger 
supervision in Uganda, and a need for improvements to the 
pre-packaging in Burkina Faso, which was conducted before 
blister packs were commonly available."*^'*** 

The 13 studies that investigated RDT-confirmed diagnosis 
and treatment of malaria showed encouraging results in the 
ability of CHWs to use RDTs and treat according to the result 
when they received practical training with an opportunity for 
observation of practice and problem solving. Three of the 
studies that measured the quality of CHW performance 
according to the number of steps correctly conducted in 
preparing and conducting an RDT, and the proportion that 
read the result correctly^^ ''^ '''^ reported substantial and statis- 
tically significant improvements (Supplemental Table 2). 
Appropriate treatment according to RDT result in terms of 
proportion of RDT-positive and RDT-negative patients 
treated with ACT was reported by seven and four studies, 
respectively. Among these studies, appropriate treatment by 
the CHWs was high (median = 97.7% RDT-positive patients 
receiving ACT; IQR = 92.7-99.3% and median = 

8.4% of RDT-negative patients receiving ACT; IQR = 4.6- 
15.5%).i»-33-3«v 

Interventions to improve quality of CHW performance: 
integration of malaria CCM with other health interventions. 

The findings from 14 studies in which CHWs delivered other 
child health services in addition to malaria CCM were consis- 
tent with the malaria-only programs in terms of achieving 
high adherence to malaria CCM algorithms, both presump- 
tive and confirmed (Supplemental Table 2). Two notable 
exceptions were the community-directed intervention study 
in Cameroon, in which only 27.9% (19 of 68) of febrile chil- 
dren received prompt and effective treatment after two years 



of intervention, and a study in Kenya, in which 41.0% (39 of 
95) of febrile children received the correct dose of antimalar- 
ial drug after 12 months of intervention.'''' In Cameroon, 
national policy changed from presumptive to confirmed diag- 
nosis during the intervention, which meant that malaria CCM 
could not continue. In Kenya, refresher training after the first 
evaluation led to improvements with 92.7% (115 of 124) and 
90.5% (237 of 262) of febrile children receiving the correct 
dose of antimalarial drug after refresher training after two 
and four years of intervention, respectively. 

The CHWs in nine of the integrated studies were trained 
to diagnose uncomplicated pneumonia and treat with antibi- 
otics. A median of 75.8% (IQR = 60.0-81.0%) of children 
given a diagnosis of pneumonia received an antibiotic among 
eight studies that reported the outcome.""-^^'"^-'''^''*^'"**' How- 
ever, the proportion of pneumonia diagnoses made by CHWs 
that agreed with a clinician gold standard was lower and var- 
iable (median = 63.7%; IQR = 47.1-77.7%) among the six 
studies that reported this outcome.^^-^''-'*^-'*'*-'*'^ 

For example, problems measuring respiratory rates and 
classifying pneumonia were reported by Gilroy and others in 
their evaluation of the iCCM program in Malawi in which 
only 51.7% (30 of 58) of children with fast breathing and 
cough were correctly classified, of whom 83.3% (25 of 30) 
received an antibiotic.'*'^ Conversely, in an evaluation of 
CHW performance conducted immediately after training on 
the use of RDT for malaria diagnosis and respiratory timers 
for pneumonia diagnosis in Uganda, 84.6% (154 of 182) of 
respiratory timer readings were in agreement with those of 
the study clinician.** Likewise, in a cluster RCT in Zambia, 
CHWs followed the classification algorithm well, classifying 
98.3% (362 of 378) of children with fast breathing as having 
pneumonia.^" The positive results observed by Mukanga and 
others in Uganda immediately after training*'* were main- 
tained over the 12-month follow-up period of the cluster 
RCT; 98.3% (520 of 529) of children with a high respiratory 
rate in the intervention arm received an antibiotic compared 
with only 0.90% (4 of 446) of children with a normal breath- 
ing rate.^"* Results from Burkina Faso and Ghana, the two 
other countries involved in this multi-site study, were not 
quite as impressive: 79.0% (181 of 229) and 72.5% (103 of 
142) of children with high respiratory rate were given anti- 
biotics, respectively. Overuse of antibiotics was of greater 
concern; 38.5% (114 of 296) of children with a normal respi- 
ratory rate received antibiotics in Burkina Faso and 44.6% 
(197 of 442) of children with a normal respiratory rate 
received antibiotics in Ghana.^"^ The authors suggested that 
more intensive supervision in Uganda may explain the differ- 
ence between countries. 

Interventions to strengthen health system support for 
CCM. There were few studies that specified a separate health 
worker or health system strengthening component to the 
malaria CCM intervention. Eleven studies reported specifi- 
cally on training health workers to support CHWs; e.g., 
retraining health workers on malaria case manage- 
ment, ^^^■^■'•^'^'^^ orientating health workers to accept and treat 
referrals sent by CHWs,^'''^'''*'' *^ or training on how to super- 
vise the CHWs and collect reporting forms and deliver drug 
supplies;^'''^^''''' the impact of this training was not clear from 
the papers. Two studies reported that pharmacists were 
trained to strengthen stock management at the health facility 
and maintain the supply chain to the community level; good 
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availability of antimalarial drug stock was reported for both 
studies during the evaluation.^^^'"*^ However, few other studies 
reported any indication of continuity of antimalarial drug 
stock during the intervention. 

Supervision was generally described as part of the context 
in which the CHWs operated, rather than as the focus of the 
intervention itself. Frequency of supervision varied between 
studies, and the most commonly reported frequency was 
monthly (although it was not always clear whether this was 
the intended or actual frequency of supervision). In general, 
those CHWs supervised by a research team were visited more 
often than those visited by public health workers; in some 
cases this finding was as frequent as two or three times a 
week. For studies in which the study team was involved in 
supervision, regular and frequent supervisory visits by experi- 
enced personnel were found to be a facilitator of good CHW 
performance.'^'-"-2"23-27-3i-33.37 

Among the studies that reported problems with supervi- 
sion, most related to health system weaknesses, such as staff 
shortages and competing priorities,^^'"'^'^^'''"' insufficient 
skills,^"*"" or a lack of fuel for transportation.^"*'^** Two reports 
provided illustrations of how poor supervision can reduce 
community and CHW confidence, which could potentially 
undermine the malaria CCM intervention: negative experi- 
ences of CHWs with formal health workers in Nigeria led 
them to bypass health facilities in favor of supervision by 
community leaders and provision of drug supplies directly 
from the district stores^^; and early evaluation of the HMM 
program in Uganda found that CHWs and communities were 
concerned about lack of supervisory support from health 
workers, which affected motivation."** 

Interestingly, the qualitative data was supported by higher 
levels of CHW performance in those studies in which supervi- 
sion was discussed in a positive light than in those studies in 
which there were negative comments by the CHWs or commu- 
nities: for 13 of the positive supervision studies with a common 
outcome indicator, the median proportion of children with 
malaria that were treated appropriately was 97.8% (IQR = 
94.0-99.5%). Conversely, for 10 of the negative supervision 
studies with a common outcome indicator, the median propor- 
tion was 78.0% (IQR = 45.4-89.1%). Although the median was 
still reasonably high, the range of results was broader, indicat- 
ing that the quality of study outcome was more variable. 

Interventions to strengthen referrals from community to 
facility-based providers. Less than one-third (13) of the stud- 
ies reported an indicator of referral, either the proportion of 
patients referred to a health facilityi5-i8.27.30,34,35,38.39.4i.43.45.46 

and/or the proportion that completed their referral (i.e., those 
who attended a health facility after being referred there by a 
CHW).^^'^^-''^^'^*-'''''"*^^ For the eight studies that reported the 
proportion of all patients referred, the median referral 



rate was 17.0% (IQR = 8.0-18.8%) 



15.18,34.38.41.43,45 



; the most 



common reasons for referral (where reported) were signs of 
severe disease or symptoms that the CHW did not have the 
capacity to treat. It is not clear whether all cases that should 
have been referred were referred. Three studies specifically 
reported the proportion of severe cases that were correctly 
referred, ranging from 29.4% to 70.0 %.-^-^^'''** Median com- 
pletion of referrals among the six studies that reported the 
indicator was 67.1% (IQR = 55.1-86.0%).^^-"'^^^-^**'"*^ "*''^ 

Only two of the studies specifically evaluated interventions 
to improve the referral system from the community to formal 



health facility level. The first study in Sierra Leone reported a 
higher completion rate (approximately 90%) for patients with 
severe malaria who were referred to a health center than for 
RDT-negative patients (only 1%) after introduction of new 
referral registers with training at the community and facility 
levels."''^ The second study in Mali reported increases in the 
proportion of children referred and completing referral after 
an intervention to strengthen the referral system and two-way 
communication between the CHW and health staff, although 
there was a discrepancy between the results of a household 
survey and the CHW referral record review. After further 
investigation, the authors reported that CHWs were more 
likely to give informal verbal referral advice to those patients 
whom they did not expect to complete the referral, but make 
a formal written reference for those patients who were likely 
to comply.*^ 

Studies in Uganda and Kenya also found evidence of CHWs 
making judgments on which patients to refer, reporting that 
they were cautious about referring patients unnecessarily and 
causing them to incur costs that they could not afford,^'' often 
choosing instead to monitor patients at home rather than refer 
immediately .^^^ Another study in Uganda reported that urgent 
cases, children less than one year of age, and those to whom 
clear instructions were given, were more likely to complete 
the referral.^** 

Impact of malaria CCM intervention on clinical outcomes. 

Eight of the 16 studies of presumptive treatment of malaria 
and 3 of the 13 studies involving diagnosis with RDTs 
reported clinical outcomes; of these 11 studies, only four were 
cluster RCTs. The significant reductions in all-cause mortality 
and severe malaria morbidity, respectively, shown by an RCT 
study in Ethiopia and a case-control study in Burkina Faso in 
the early 2000s provided strong support for the early home- 
based treatment of fever programs. **'''^ A more recent study 
in Ethiopia also reported a significant reduction in malaria- 
attributable deaths in the intervention district in which CHWs 
had RDTs and ACTs, compared with a control district with- 
out malaria CCM; no significant difference in all-cause mor- 
tality was observed.^'' In Senegal, total deaths and deaths 
attributed to malaria showed a greater decrease in regions 
with malaria CCM compared with those that had not yet 
rolled out the intervention. However, there was no significant 
decrease in outpatient malaria cases or hospitalizations 
between intervention and comparison regions.^" Similarly, 
RCTs of home management of malaria in Uganda, Burkina 
Faso, and Tanzania did not find a significant impact on mor- 
bidity outcomes such as moderate anemia, hemoglobin level, 
or splenomegaly. One encouraging finding in terms of 
clinical outcomes is that among four studies that measured 
day 28 polymerase chain reaction-adjusted cure rates, > 90% 
of patients had completely cleared their infection after treat- 
ment with an ACT from a CHW, supporting the idea that 
CHWs can prescribe the appropriate dose and that users 
adhere to this dose."*"'*^ 

Four of the 14 integrated studies reported clinical outcomes 
(all of which were cluster RCTs). A three-arm cluster RCT in 
Ghana reported a 44% reduction in all-cause child mortality 
among febrile children treated presumptively with an ACT 
and antibiotic compared with standard care (adjusted relative 
risk [RR] = 0.56, 95% confidence interval [CI] = 0.41-0.76, 
P < 0.001). Presumptive treatment with an ACT alone also 
significantly reduced child mortality by 30% compared with 
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Standard care (adjusted RR = 0.70, 95% CI = 0.53-0.92, P = 
0.01). However, there was no significant difference between 
the two intervention arms (RR = 0.79, 95% CI = 0.56-1.12, 
P = 0.20).^^ The multi-site cluster RCT in Burkina Faso, 
Ghana, and Uganda reported high fever clearance (> 95%) 
across ail three countries. However, there were no significant 
differences between the intervention arms (treatment with 
ACTs and antibiotics according to diagnoses made with 
RDTs and respiratory timers) and control arms (presumptive 
treatment with ACTs).^^ 

DISCUSSION 

Overall, the quality of malaria case management at the 
community level was high across most studies included in this 
review. In particular, extremely high compliance by CHWs to 
the correct dose was seen across the studies that reported this 
outcome; this finding was irrespective of diagnosis or anti- 
malarial drug policy, or strength of study design. All except 
one of the studies reporting this indicator involved pre- 
packaged antimalarial drugs (co-blistered or co-formulated).*' 
Although direct data on user adherence to the correct dose 
was not generally reported, four studies investigated poly- 
merase chain reaction-adjusted cure rates of a sub-sample 
of patients treated with ACT by a CHW, all of which were 
> 90%. This finding supports the notion that pre-packaged 
ACTs can be administered effectively by CHWs and adhered 
to by the users of these services. 

Appropriate treatment at the community level according to 
RDT result was higher than that found in a number of studies 
of RDT use by formal health workers, in which 30-80% 
of RDT-negative patients were treated with antimalarial 
drugs. '^"'"^ Reasons for this lack of adherence are varied and 
complex, involving trust in RDTs, maintaining clinical repu- 
tation, managing patient expectations, and availability of 
alternative treatments.''*'"''** 

In contrast to the positive findings on quality of malaria 
CCM, the evidence from this review suggests a more mixed 
performance for community-level management of pneumonia 
in the context of integration with malaria diagnosis and treat- 
ment. In general, the greatest challenge seems to be in 
measuring respiratory rate and/or classifying pneumonia; 
treatment with an antibiotic of patients classified as having 
pneumonia (rightly or wrongly) is reasonably high, provided 
sufficient stock is available.""* Studies in which pneumonia 
classification was in close agreement with the study clinician 
gold standard were cluster RCTs with intensive supervision 
and follow-up.^"'**''" As Kalyango and others reported, it is 
possible that in many settings with an established malaria 
CCM program the CHWs are familiar with the signs, symp- 
toms, and treatment of malaria, whereas legal permission to 
treat pneumonia at the community level is a more recent 
addition to their responsibilities.^^ The quality of CCM of 
pneumonia may improve with continued support, such as 
supervision and/or refresher training with opportunity for 
problem solving. 

Less than one-third of the studies included in this review 
reported on referrals between the community and health 
facility levels. Notwithstanding that indicators can be difficult 
to monitor, this is a low level of reporting considering that 
effective referral of cases that a CHW does not have the 
capacity to treat is a crucial element of safe implementation 



of CCM. Evidence from included studies suggests that CHWs 
and patients make judgment decisions around the referral 
process. When CHWs were trained to treat all cases of fever 
as malaria, criteria for referral were relatively straight- 
forward, generally involving training on recognition of danger 
signs and referral of such patients to a health facility after 
treatment with an antimalarial drug. However, with the use 
of RDTs by CHWs, there arises a challenge of what action 
should be taken for patients with a negative RDT result. In 
the longer term, development of additional point-of-care 
diagnostic tests to complement malaria RDTs and to help 
differential diagnosis is likely to be helpful. In the meantime, 
provision of clear guidance on appropriate management of 
undiagnosed fevers and clear process monitoring of CHW 
referral systems and qualitative studies of provider and 
caretaker behavior around referrals are essential to ensure 
patient safety. 

Supply chain strengthening, including forecasting and mon- 
itoring, is vital in ensuring that CHWs can effectively carry 
out their task. Likewise, capacity of health workers at primary 
public health facilities in the integrated management of child- 
hood illnesses and management of severe malaria or pneumo- 
nia is an important factor to the overall success of community 
case management because under routine conditions, it is these 
health workers who have the responsibility for supervising the 
practice of CHWs and treating referred cases. Few of the 
studies included in this review reported quantitative indica- 
tors of health worker capacity, and despite the likely need, 
only approximately 25% of studies specified any health 
worker training as part of the intervention. With the excep- 
tion of two studies that successfully improved CHW stock 
continuity through training of health facility pharmacists,^' "*^ 
it was not always clear to what extent such intervention had 
been effective. A recent systematic review and meta-analysis 
concluded that training in integrated management of child- 
hood illnesses could improve quality of treatment of child- 
hood illnesses at health facility level, particularly when 
implemented in conjunction with greater supervision.'* The 
variety of challenges for those studies in this review that 
did not have intensive involvement of a research team also 
support that training alone is insufficient to improve health 
system capacity; more in-depth assessment of the needs at the 
supervising health facility level will be needed to design 
appropriate interventions to support CCM. 

Sufficient supportive supervision is a recurrent facilitating 
factor in studies of health worker performance at all levels 
of the health system, and this review reinforces its impor- 
tance in maintaining the quality of CCM. In general, super- 
vision was more frequent in the studies conducted under 
controlled research conditions compared with studies that 
evaluated larger scale real-life implementation of malaria 
CCM. Although it is not possible to make quantitative con- 
clusions because of differences in intervention details and 
study design, qualitative analysis suggests that when super- 
vision is considered by CHWs to be sufficiently frequent and 
supportive, this factor can encourage higher CHW motivation 
and performance. In addition, respect and support from formal 
health workers can build trust of CCM within the community. 
This finding is supported by another recent Uterature review, 
which suggested that to understand treatment seeking behavior 
fully, characteristics of providers*'' should be considered in 
addition to those of users.*^ Kizito and others reported that 
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traditional barriers such as cost and proximity are important; 
however, they also report that health services may increase 
their appeal if they responded to user preferences for friend- 
liness, effectiveness, compassion, and shorter waiting times/* 
Further research is needed to translate effective supervision 
strategies from research settings to scaled-up programs. 

It is not possible to comment on the achievement of one of 
the fundamental objectives and stated strengths of CHWs in 
improving socioeconomic (and geographic) access to care* 
because it was rarely reported. Often CHW programs are 
designed to target hard-to-reach communities (e.g., those 
> 5 km from a health facility or in the lowest socioeconomic 
quintiles). It may be that equity was incorporated into the 
design of the intervention rather than being directly mea- 
sured. Nevertheless, whenever possible, it is important to 
evaluate whether a CHW program has actually achieved 
improved equity of access to included interventions. 

Another area of limited evidence is cost-effectiveness of 
malaria CCM. Nine of the included studies reported a costing 
element, ^'^'^**"''"'"'*'*'^'*"' with variations in purpose and method 
of data collection. Although malaria CCM appears to be a less 
costly approach compared with standard care for malaria 
treatment at a health facility, the variety of costing methods 
means it is not possible to present a clear picture of the cost- 
effectiveness of the approach. In particular, data are needed 
for indirect opportunity costs for CHWs volunteering their 
time.** More economic evaluations of malaria CCM are 
needed, and standardization of methods to enable cross-study 
comparison will be extremely valuable. 

As this and other recent reviews highlight, there is still 
relatively little evidence that CHWs can impact on mortality 
or morbidity, ^^'*^^ although there is reasonable evidence they 
can perform well with adequate supervision and health system 
support. Health impact studies rarely reported process or out- 
come indicators that would help understand health outcomes 
and relate these to the strength of implementation. '*'^^^ Simi- 
larly, most of the program evaluations focused on process and 
outcome indicators but did not report on health outcomes 
(and were not designed to do so). This finding suggests an 
area for further investigation, namely for studies that are 
powered to measure impact of malaria CCM on morbidity or 
mortality to also include process evaluation in their design so 
that inference can be drawn on the level of implementation 
of malaria CCM needed to achieve health impact. 

It is important to note the potential limitations in terms 
of the reliability of data extracted from the included studies. 
Many of the studies reported data on antimalarial drug use 
and dosage from reviews of the CHW registers, which may 
have incomplete or inaccurate reporting. Others report the 
proportion of febrile children receiving an effective antima- 
larial drug at the correct dose from household surveys, which 
can have problems with recall and understanding. Direct 
observation of CHW performance is considered the gold stan- 
dard, although this observation has implications for influenc- 
ing behavior and is time and resource intensive and thus is not 
suitable for routine monitoring. However, despite these limi- 
tations, the small number of studies that collected data from 
CHW registers and household surveys to triangulate data 
generally found encouragingly similar results."''^ ''^ Where pos- 
sible, validation of data from different sources is desirable. 

In conclusion, the findings from this review support the 
potential for CHWs to implement quality care of malaria at 



the community level, even with increasing complexity of their 
roles and responsibilities. More evidence is emerging on the 
integration of malaria CCM with other health services, partic- 
ularly from programs that follow iCCM approach. CHWs are 
able to treat uncomplicated pneumonia, although there is 
room for improvement, particularly in accurate diagnosis. 
Important facilitating factors for success include interactive 
and practical training, clear guidelines, and regular supportive 
supervision. However, there is an urgent need for more 
evidence on supervision in the context of scaled programs, 
as well as the most appropriate course of action for RDT- 
negative patients and the effective referral by CHWs of cases 
that they are unable to treat. It is a cause for concern that 
such limited evidence exists on this area, given the crucial 
role that referral must play in ensuring patient safety when 
responsibility for case management is transferred to low-level 
community providers. 
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